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H. Leon Harter 


Aeronautical Research Laboratories 
Wright-Patlerson Air Force Base, Ohio, U. S. A. 


SUMMARY 


David B. Duncan [2] has formulated a new multiple range test 
making use of special protection levels based upon degrees of freedom. 
Duncan [Tables II and III} has also tabulated the critical values (sig- 
nificant studentized ranges) for 5 percent and 1 percent level new 
multiple range tests, based upon tables by Pearson and Hartley [8] 
and by Beyer [1]. Unfortunately, there are sizable errors in some of the 
published critical values. ‘This fact was discovered and reported by 
the author [4], who instigated the computation at Wright-Patterson Air 
Force Base of more accurate tables of the probability integrals of 
the range and of the studentized range than those published by Pcarson 
and Hartley (7, 8]. This extensive computing project, of which one of 
the primary objectives was the determination of more accurate critical 
values for Duncan’s test, has now been completed. The purpose of 
this paper is to report critical values (to four significant figures) which 
have been found by inverse interpolation in the new table of the prob- 
ability integral of the studentized range. Included are corrected tables 
for significance levels a = 0.05, 0.01 and new tables for significance levels 
a = 0.10, 0.005, 0.001—all with sample sizes n = 2(1)20(2)40(10)100 
and degrees of freedom » = 1(1)20, 24, 30, 40, 60, 120, ~. 


INTRODUCTION 


Multiple range tests are used for testing the significance of the range 
of p successive values out of an ordered arrangement of m means of 
samples of size N, where p = 2, ---, m. First one tests the significance 
of the range of all m means by comparing it with the critical range for 
the desired level of significance. If the range of all m means is found 
to be significant, one next tests the significance of the range of (m — 1) 
successive means, omitting first the largest and then the smallest (or 
vice versa—order is unimportant); if either of these tests on (m — 1) 
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means shows significance, one then proceeds with tests on (m — 2) 
successive means, and so on until no further groups are found to have 
significant ranges. Whenever the range of any group is found to be 
non-significant, one concludes that the entire group has come from a 
homogeneous source, and no test is made on the range of any subgroup 
of that group. Multiple range tests differ from fixed range tests in 
that the critical range of p means usually decreases as p decreases, 
rather than remaining constant. 

The new multiple range test proposed by Duncan [2] makes use of 
special protection levels based upon degrees of freedom, Let y2.. = 
1 — a be the protection level for testing the significance of a difference 
between two means; that is, the probability that a significant difference 
between sample means will not be found if the population means are 
equal. Duncan reasons that one has (p — 1) degrees of freedom for 
testing p means, and hence one may make (p — 1) independent tests, 
each with protection level yz... Hence the joint protection level is 


Ye.e = (¥2.6)”' = (1 — a)"; (1) 


that is, the probability that one finds no significant differences in making 
(p — 1) independent tests, each at protection level ya.0 , is y374 , Under 


the hypothesis that all p population means are equal. 


CRITICAL VALUES FOR DUNCAN’S TEST 


On the basis of protection levels y,,. given by (1) for tests on p 
means, Dunean [2, Tables II and ITT) has tabulated the factor Q(y, +, a) 
by which the standard error of tue mean must be multiplied in order 
to obtain the critical range for Duncan’s new multiple range test, for 
a = 0.05, 0.01. In the sequel, this factor Q(p, v, a) will be called the 
critical value or the significant studentized range for Duncan’s test. 

As mentioned earlier, Duncan’s tables of significant studentized 
ranges are based upon tables by Pearson and Hartley [8] and by Beyer 
{1}. The tabular values for 2 < p < 20 and 10 < » < © were obtained 
by inverse interpolation in the Pearson-Ifartley tables of the probability 
integral of the studentized range, while the remainder of the values 
were computed by Beyer, using new methods. ‘The Pearson-IHartley 
tables of the probability integral ,P,(Q) of the studentized range, with 
» degrees of freedom for the independent estimate s’ of population 
variance, are based upon their earlier tables of the probability integral 
P,(Q) of the range of n observations from a normal population. ‘To 
correct for finite degrees of freedom, they use the relation 


PQ) = PQ) + ¥'a,(Q) + ¥°7b,(Q). (2) 
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‘The tables give vaiues (to four, two and one decimal places, respectively ) 
of P,(Q), a.(Q) and 6,(Q) for Q = 0.00(0.25)6.50 and n = 3(1)20, with 
the observation that the results are somewhat inaccurate for small 
values of »(<10) and large values of Q(>6). Actually, the tables are 
inaccurate not only for vy < 10, but also for values of » up to about 20, 
and the inaccuracy for high values of Q is much greater than was 
anticipated. The inaccuracies in the Pearson-Hartley tables, which 
were due to the limitations of formula (2), in turn caused errors in the 
published critical values for Duncan’s test. Beyer was aware of the 
difficulty for » < 10, and attempted to correct it by adding a term of 
the form v~*e,(Q) to the right-hand side of (2). This alleviated the 
difficulty to some extent, but did not remove it, and nothing at all was 
done to correct the inaccuracies for » > 10. Having first become 
aware of this situation during the course of an investigation of the 
relation between error rates and sample sizes of multiple comparisons 
tests based on the range (see reference (3]), the author [4] reported it 
in a paper, presented to the American Statistical Association, which 
included an outline of plans for the computation of more accurate 
tables. 


COMPUTATION OF THE TABLE 


The computation of more accurate critical values for Duncan’s 
{est required the computation of a more accurate table of the prob- 
ability integral of the studentized range, and this in turn required the 
computation of a more accurate table of the probability integral of 
the range. Dr. Gertrude Blanch gave invaluable assistance in the 
numerical analysis. Donald S. Clemm programmed the computation 
of the probability integrals of the range and of the studentized range 
for the Univac Scientific (ERA 1103) computer. Teugene H. Guthrie 
programmed for the ERA 1103A the inverse interpolation necessary 
to obtain the critical values for Duncan’s test. 

The methods of computation of the probability integrals of the range 
and of the studentized range, together with voluminous tables, have 
been reported by Harter and Clemm [5] and by Harter, Clemm and 
Guthrie [6], and will not be repeated here. The method of inverse 
interpolation employed, an iterative one suggested by Major John V. 
Armitage, involves the following steps: 

1. In the table of the probability integral of the studentized range for 
n = pand the desired value of », find the two successive probabilities, 
yo and y, , between which the required protection level P = y.4 = 
(1 — a)?" fies. Call the two corresponding arguments (studentized 
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ranges) 2» and z, , respectively. The required studentized range 
Q = R(p, », ve.2) Will lie between x» and z, . 

2. ‘‘ompute the tolerance T for P corresponding to a tolerance 5 X 10°~° 
for 2 by means of the equation T = (AP/AQ) X 5 X 10*°, where 
AP = y; — yo, AQ = x, — 2 and wu is the number of digits before 
the decimal point in numbers between 2, and 2, . 

3. Perform lin-ar inverse interpolation to find an approximation z to 
the required 2'9, v, y,..), using the relation 


r= [tr — IP — w)/(y — Yo)] + Xo. 


4. Perform direct interpolation, using Aitken’s method with a tolerance 
of 5 X 10°’ and with provision for up to 16-point interpolation if 
the tolerance is not met for fewer points, to find the probability y 
corresponding to the value z of the studentized range. 

. Compare the result y of step (4) with the required probability P, 
using the tolerance 7 computed in stcp (2): 

a. If|y — P| < 7, stop and set R(p, v, v9.0) = 2. 

b. If (y — P) > T, replace y, by y and x, by z, then repeat the 

process, starting with step (3). 
ce. If (y — P) < —T, replace yo by y and xq by 7, then repeat the 
process, starting with step (3). 

Once R(p, », y,.2) has been found, the critical value Q(p, v, a) for 
Duncan’s test is determined as follows: Q(p, », a) = R(p, ¥, Y,.2) for 
p = 2 and Q(p, », a) = max [R(p, », ¥y.«), Ap — 1, ¥, «)] for p > 2. 
The results are given in Table 1. 

Values for » = ©, obtained by inverse interpolation in the table of 
the probability integral of the range, are included for convenience in 
interpolation (linear harmonic v-wise interpolation is recommended). 


ot 


ACCURACY OF THE TABLE 


The table of the probability integral of the studentized range, on 
which the table of critical values for Duncan’s test is based, is accurate 
to within a unit in the sixth decimal place (except for values of the 
probability greater than 0.999995, which are given as 1.00000), and 
the interval is small enough to make interpolation possible. The 
tolerance for the direct interpolation was set at 5 & 107’ so that the 
interpolation error would not add appreciably to the error already 
present, and hence the interpolated values are substantially as accurate 
as the values in the input table. Inverse interpolation is, of course, 
not as accurate as direct. interpolation, the error being AQ/A4P times 
as great for inverse interpolation as for direct interpolation. Thus the 
tolerance for P was found by multiplying the tolerance for Q(5 * 10°7*) 
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by 1/(AQ/AP) = AP/AQ. Since u is defined as the number of digits 
before the decimal point in the studentized range interval under con- 
sideration, this would guarantee that the error in Q would not exceed 
5 units in the fifth significant digit if the ratio of the change in P to 
the change in @ were constant throughout the interval under considera- 
tion. This condition (P piecewise linear in Q) is obviously not satisfied 
in practice, but as long as the weaker condition 


max [APo/AQo ’ AP,/AQ,) < 2 4P/AQ, 


where AP, = | y — y, | and AQ; = | r — +, | (¢ = 0, 1) is satisfied, the 
error in Q will not exceed a unit in the fourth significant digit. This 
weaker condition is in fact satisfied, and hence it can be stated that 
the error in the critical values for Duncan’s test, which are given in 
Table 1, does not exceed a unit in the fourth and last significant digit. 
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